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DESCRIPTION 
METHOD FOR IMPLEMENTING MPBG-21 IPMP 

TECHNICAL FIELD 

The present invention relates to method of digital item 
processing for use in an apparatus for a MPEG=21 system,, 
specifically content distribution and protection in MPEG-21 
(Moving Picture im.age coding Experts GrQup-21) scope. The 
present invention especially relates to such applications 
where the protected content is delivered and transferred 
based on MPEG-21 compliant devices and consumed based on 
standardised Rights Expression information, 

BACKGROUND ART 

Today,- many elements exist to build an infrastructure 
for the delivery and consumption of multimedia content. 
There is^ however, no "big picture" to describe how these 
elements, either in existence or under dev^elopment, relate 
to each other. The aim for MPEG-21 is to describe how 
these various elements fit together. Where gaps exist, 
MPEG-21 v/ill recommend which nevv'' standards are required. 
MPEG will then develop new standards as appropriate while 
other relevant standards may be developed by other bodies . 
These specifications vjill be integrated into the multimedia 
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framework through collaboration between MPEG and these 
bodies • 

MPEG-21 aims at setting out a vision for enabling 
transparent and augmented use of multim-edia resources 
5 across a wide range of networks and devices used by 
different communities. The setting up "big picture" is to 
describe how^ the specification of all the elements,, which 
exist to build an infrastructure for the delivery and 
consumption of multim-edia content. Noxa? six key technical 

10 elem_ents have been defined in MPEG-21: DID (Digital Item 
Declaration) , DII&D (Digital Item Identification and 
Description), IPMP (Intellectual Property Management and 
Protection) , RDD (Rights Data Dictionary) ^ REL (Rights 
Expression Language) - and DIA (Digital Item. Adaptation) . 

15 Digital Items are defined as structured digital 

objects,- including a standard representation and 
identification, and m.eta-data. This entity is the 

fundamental unit of distribution and transaction within the 
MPEG-21 framework as a whole. The means by which a Digital 

20 Item is defined is a Digital Item Declaration, The DID 
specifies the makeup, structure, and organization of a 
Digital Item. The DID has defined a useful model formed by 
a set of abstract terms and concepts for defining Digital 
Items. Within this model, a Digital Item is the digital 

25 r"PJ r~i r"-» c; cari "h :a 1^ i n"n "F " =i tArr^vV-'' a n nl sic: c?n/-^V> -i-*- 4-V»x^ -3 4- 
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that is acted upon (managed, described, exchanged, 
collected, etc.) vvithin the model. The goal of this model 
is to be as flexible and general as possible, while 
providing for the "hooks" that enable higher-level 
functionality. This, in turn, will allow the model to 
serve as a key foundation in the building of higher-level 
models in other MPEG-21 elements. 

In MPEG standardisatioiTL group, people are working 
towards to standardise an IPMP (Intellectual Property 
Management and Protection) system that involves compliant 
terminal. All the terminals can represent a protected 
content that is encrypted and protected by following the 
same IPMP standard, no m.atter v/hat kinds of IPMP tools they 
use. The IPMP element should also fit into DID m.odel . But 
the current MPEG-21 IPMP terminal architecture cannot fit 
the requirem.ent for MPSG-21 framework bas 
distribution and protection, 

MPEG has identified the need for a Rights Expression 
Language (REL) and a Rights Dictionary Data (RDD) for long 
time. And now it is setting up two new parts for REL/RDD 
in MPEG-21 for standardization. Where is the place that 
the Rights holder including the rights expression 
information should be put is an issue for a practical 
system. 
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DISCLOSURE OF IinTvENTION 

An object of the present invention is to provide an 
interoperable and secure architecture to be used in MPEG-21 
DI delivery or transmission in a secure manner. 
5 Another object of the present invention is to provide 

the standard way for MFEG-21 IPMP system implementers to 
build a complaint MPEG-21 IPMP system for MPEG=21 related 
"content" distribution and protection. 

Further object of the present invention is to design an 
10 appropriate and reasonable place to place the Rights Holder 
including Rights Expression information with the content 
under MPEG-21 IPMP system architecture and its mapping to 

The objects of the invention are achieved by following 
15 means: 

a means to define and standardise a MPEG-21 system to 
be implemiented in a compliant MPEG-21 Device; 

a means to incorporate MPEG-21 IPMP into MPEG-21 system 
architecture; 

20 a means to protect Resources using MPEG-21 IPMP system 

from request to consumption; 

a means to define the place for Rights Holder to carry 
the rights expression information; and 

a means to map the Rights Holder in MPEG-21 IPMP to 
Mir'jii^ z/ ^ j-ir*M£^ xor content m.anagem.ent and domain m.anagement» 
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On the content provider side, aii incoming "content" is 
encoded and fonTied to be a iy[PEG-21 Digital Item, If the 
digital item is protected using HPEG-21 IPMP, IPMP Control 
Information needs to be retrieved and constructed. At the 
same time Rights Holder also needs to be retrieved and 
constructed. 

Rights Holder should be carried in an appropriate 
place if it is bound together with the content, either 
sitting under IPMP system, or parallel to IPMP system.. It 
is also possible to be carried and tran.smitted out of the 
band. 

After DID is received at MPEG-21 (BE) MUX and sent to 
DID parser, the DID parser extracts IPMP information and 
sends to IPMP parser. Then the IPMP parser extracts all 
IPMP information and transfers the information to IPMP Tool 
Manager and Message Router in MPEG-21 IPMP system. Other 
IPMP Inform.ation such as IPMP mLessage, Keys, etc could be 
put as OpaqueData in IPMP Descriptor or the Resource 
element in DID, When there is Rights Expression 

information under IPMP Control Information Descriptor, it 
is transferred to REL parser. The parsed rights 

information can be enforced by Rights Management Tool 
carried in the DID or the Resource through Descriptor 
Reference (remotely) . The Rights Expression information 
could also be carried out of band, or parallel to the IPMP 
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information, or even scattered into different resources. 

In other words, a first aspect of the present 
invention provides, a method of digital item processing for 
use in an apparatus for a MPEG-21 system, comprising: 
5 requesting a digital item to be delivered to the apparatus 
via a network, receiving the requested digital item, de- 
multiplexing the received digital item by a de=multiplexer, 
retrieving a digital item container including a Digital 
Item. Declaration (DID) including one or m^ore elem.ents from. 

10 the de-multiplexed digital item, parsing the DID by a DID 
parser to interpret the actual meanings of each element of 
the DID, and transferring the element to an Intellectual 
Property Management and Frotection (IPMP) parser for 
activatin.g an IPMP tool if the interpreted elem.ent is 

15 related to protection and management of the digital item, 

A second aspect of the present invention provides, A 
mtethod of digital itemi processing in an apparatus for a 
MPEG-21 system, comprising: receiving a DID menu together 
with other information including DID in a carousel style 

20 via a network, parsing DID by a DID parser to interpret the 
actual meaning of each element of the DID, making the DID 
menu to be readable by a user, selecting a digital item 
from the DID menu by the user, verifying rights and usage 
rules which is bound to the digital item if REL information 

^ no -F r^i iy~\rs t.ttt-V» -i-oci Hi/^tt-ciT t-i- t^rrx jss t- i cstt-1 ^ 4- 1^ ^ ^ , ^ « 4- ^ ^ 

^ -J- 1^ j-wu-Axw. vv^L^JLX i_xx\-. v>L j_ j_ L- t-i-i- J-l_^^J.LL, j_ i_ J — ut;vj-AJ.y i ^ U. O U CkJ= 
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digital item, un-protecting the digital item for further 
consumption if the digital item is protected by IPMP, 
identifying a resource linked to the digital item, 
collecting the requested tools including IPMP tools, 
5 content representation tools, and DxA tools for consumption 
of the digital item, activating the tools according to pre- 
determined message interface if such tools are required in 
the consumption of the digital item. 

A third aspect of the present invention provides, A 

10 method of digital item processing in a MPEG-21 system, 
wherein the system includes a server and a client, 
comprising: browsing a DID menu stored in the server 
remotely from the client by a DID browser via a netvvork, 
parsing and interpreting each DID elem.ent by the DID 

15 browser, selecting a digital item described by the DID by a 

v^i^w^, V w J- _i_ j_ _y j_ J. J. j_ j_ 'wjij. u- OLxxswX uLkjcJ-y^ j_LJ.j_c=c> U-X XVJ. Uiit; iJ.J_y_LL.Ct_L 

item, if P>.EL information is found with the digital item, 
delivering the requested digital item from the server to 
the client, un-protecting the digital item for further 

20 consumption if the digital item is protected by IPMP, 
identifying a resource linked to the digital item, 
collecting the requested tools including IPMP tools, 
content representation tools, and DIA tools for consumption 
of the digital item, activating the tools according to pre- 

25 determined message interface if such tools are required in 
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the consuiaption of the digital item. 

BRIEF DESCRIPTION OF DRAWINGS 

This and other objects and features of the present 
invention will become clear froin the subsequent description 
of a preferred embodiiaent thereof made with reference to 
the accompanying drawings r in v^hich like parts are 
designated by like reference numerals and in which: 

Fig. 1 is an architecture diagram shoxving a basic 
conception of MPEG-21 IPMP architecture of the im/ention; 

Fig. 2 is an architecture diagram showing MPEG-21 IPMP 
with Protected MPEG-21 DI (Rights Information under IPMP 
Control Information) according to a first eiribodiment of the 
present invention; 

Fig. 3 is a diagram showing a relationship between DID, 
DIID and IPMP Scheme; 

Fig. 4 is a diagram shoiving a data structure for 
rights carried out of the band; 

Fig. 5 is a diagram showing a data structure for 
rights carried in MPEG-n system in global location; 

Fig. 6 is a diagram showing a data structure for 
rights carried in MPEG-n system in local; 

Fig. 7 is an architecture diagram for MPEG-21 IPMP 
with Protected MPEG-21 DI (Rights Information parallel to 
IPMP Control Information) according to a second embodiment 
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of the present invention; 

Fig. 8 is a diagraiu shoiving a data flow for rights 
carried in lOD of MPEG- 4 system (rights information under 
IPMP control inf orm.ation) ; 
5 Fig* 9 is a diagram showing a data flow for rights 

carried in lOD of MPEG-4 System (rights Information 
parallel to IPMP Control Information) ; 

Fig. 10 is a diagram showing an overview of an IPMP 
protected MPEG-2 content (rights information under IPMP 
10 control information) ; 

Fig. 11 is a diagram showing an overview of an IPMP 
protected MPEG-2 content (rights information parallel to 
IPMP Control Information) ; 

Fig. 12 is a flow chart of MPEG-21 DI consum^ption ivith 
15 rights Information carried inside IPMP Information; 

rights informLation carried before accessing IPMP 
Information; 

Fig. 14 is an architecture diagrairi showing MPEG-21 
20 IPMP with Protected MPEG-21 DI (Rights Information under 
IPMP Control Information) according to a third embodiment 
of the present invention; 

Fig. 15 is a schematic architecture diagram for 
illustrating a DID menu transferred from a server to a 
25 terminal; and 
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Fig. 16 is a schematic architecture diagram for 
illustrating a DID menu stored in a server and browsed by a 
terminal . 

5 BEST MODE FOR Ci^RRYING OUT THE INVENTION 

Digital Items are defined as structured digital 
objects,. including a standard representation and 
identification, and meta-data, which subordinates to the 
respective Digital Items to explain respective contents 

10 for example,, data on a title and copy authorization for 
motion picture. This entity is the fundamental unit of 
distribution and transaction within the MPEG=21 framework 
as a whole. Focusing on this unit related to MPEG-21^ the 
six technical elements existing under MPEG-21 are briefly 

15 described and listed below: 

-! i-^ -1 *1 ~r 4— w» "P\ /-\ T ^ -V^ ^4— T^V-l /—t llT^T-f-j^ -|»~TY^ 'TMTS -f- 1 T 1 fTS 

J=J J= y CIJL =L UdLl J_ Ca. -L- CL _L W J. J. I CX LXXJ. J. J. W J-XLL a.±±VJ. J- -L JLJv^JU 

abstraction and interoperable schema for declaring Digital 
Items) : it specifies the mechanism for declaring the 
structure and makeup of Digital Items; 

20 Digital Item Identification and Description (a 

framework for identification and description of any entity 
regardless of its nature,- type or granularity) : it 
specifies how Digital Items and parts and collections 
thereof can be described and uniquely identified; 

25 Intellec tual FjTOperty Management and. Protection 
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Architecture or Tool Representation and Cornrivanication 
System (the means to enable content to be persistently and 
reliably managed and protected across a wide range of 
networks and devices) : it specifies information related to 
5 intellectual property management and protection associated 
with the Digital Item; 

Rights Expression Language (a machine-readable 
language that can declare rights and permissions using the 
term.s as defined in the Rights Data Dictionary) : it 
- 10 specified flexible^ interoperable mechanisms to support 
transparent and augmented use of digital resources and 
express their rights and interests in a vjay that addresses 
issues of privacy and use o£ persona.! daua^ 

Rights Data Dictionary (a set of clear,- consistent 
15 structured and integrated definitions of terms for use in 
T^v^0 I^IPEG — 21 Ricfhts Expression lianc^uacre) ^ 

Digital Item Adaptation: provide tools to support 
resource adaptation, descriptor ("metadata") adaptation, 
and Quality of Service management. 
20 A "tool" referred to in this specification is a 

computer executable program to execute one or more 
predetermined processes such as mutual authentication, 
decryption which comforms to Data Encryption Standard (DES) . 
Such programs are available in the form, of Dynamic Link 
25 Libraries (DLLs), JAVA code program modules, etc* 
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Fig. 1 shows basic concept to MPEG-21 IPMF system 
architecture. In Fig. 1,- it is assuraed that content in 
module 1.1 coming into MPEG-21 IPMP system is an MPEG-^ai 
protected multimedia. In fact, under MPEG-21 "big picture",- 
the coming content is called Digital Item in MPEG-21 
framework. Three units 1.2 1.3^ and 1.4 in module 1.1 
illustrate IPMP inform.ation transferred in content for IPMP 
system processing. An IPMP Tool List (unit 1.2) identifies, 
and enables selection of, the IPMP Tools required to 
process the Content. An IPMP Tool Elem.entary Stream (unit 
1.3) identifies tlie actual tools carried in the Content 
itself. IPMP information (unit 1.4) identifies the 

information directed to a given IPMP Tool to enable,- assist,- 
or facilitate its operation. 

As for right part of Fig. 1, it shows an MPEG~21 IPMP 
terminal 200 or client (module 1.5, a device that consumes 
possibly protected incom.ing content in compliance with the 
usage rules) including IPMP Tool Manager (module 1.6, 
proceeses IPMP Tool List (s) unit 1.2 and retrieve the IPMP 
Tools modules 1.8, 1.9, 1.10, 1.11 that are specified 
therein) and Message Router (module 1.7, implements the 
Terminal-side behavior of the Terminal-Tool interface) . 
The module 1.8 of Missing IPMP Tools (not available in the 
module 1.5) and the module 1.9, 1.10, 1.11 of IPMP Tool 
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(one or more) IPMP functions such as authentication, 
decryption, and vvatsriuarking. 

First Smbodiment 
Fig, 2 shows a first embodiment of the present 
5 invention. As shown in Figure 2,- the updated Architecture 
Diagram for MPEG-21 IPMP is built on top of the assumed 
MPEG-21 System which may be MPEG-21 File Format (mLodule 
2.14). So in a MPEG-21 terminal 202 as shown in Figure 2, 
a MPEG-21 System. De-Mux m.odule 2*9 is required to process 
10 binary-form MFEG-21 data which includes de-muxing and 
converting of DID binary to XML, then the processed data is 
passed to DID Parser module 2.9 for further processing. 

The means by Wiij-Cii a Digxta.! Item is dearined. is a 
Digital Item. Declaration, (unit 2.2). The whole structure 
15 is illustrated in Fig.* 3. The DID specifies the makeup, 

itemt container (unit 2.1) . The Digital . Itemi includes a 
list of the resources, relevant metadata, and the 
relationships among the parts. The DIB has defined a 
2 0 useful model (unit 3.1 in Fig. 3) formed by a set of 
abstract terms and concepts such as Container, Item, 
Component, Anchor, Descriptor- Condition, Choice, Selection, 
Annotation, Assertion, Resource, Fragment, Statement, etc 
(e.g. units 3.13, 3.7, and 3.8 shown in Fig. 3) for 
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is the digital representation of "a work", and as such, it 
is the iteiti that is acted upon (laanaged, described, 
exchanged, collected, etc) within the model. The goal of 
this model is to be as flexible and general as possible, 
while providing for the "hooks" that enable higher=level 
functionality. This, in turn, will allow the model to 
serve as a key foundation in the building of higher-level 
models in other MPEG-21 elements. The IPMP element should 
also fit into this model. 

The IPMP framework is a terminal system, that supports 
tools for protecting Digital Item (DI) and enforcing rights 
expressions that might be associated v/ith. One XML-based 
component, named "IPMP_Scheme" descriptor [1] under DID 
model to link DID with IPMP fraro_ework. 

The new architecture diagram for MPEG-21 IPMP 
vvalkthrough concept considering" MPEG— 21 IPMP protected 
content - DI (unit 2.1) can be seen in Figure 2. MPEG-21 
protected contents in server 201 is illustrated in the left 
side, which can be considered as the basic MPEG=21 concept 
entity DI 2.1. The DI 2.1 includes crucial/core entity DID 
(unit 2.2) and its referred Resource (unit 2.8). We use 
"DI request" and "DI delivery" to denote MPEG-21 IPMP 
protected content-DI transmission through networks or 
communications 200. In Fig. 3, the whole DID model 
includes DIID (unit 3.5) and IPMP information (units 3.2, 
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3.3, and 3.4) held in IFMP Scheme descriptor can be seen. 
Two descriptors, "IPMP Control Inforinaation Descriptor (unit 
3.2)" and "IFMP Descriptor (units 3.3 and 3.4)". These 
Descriptors can also seen in the architecture diagram of 
5 Fig. 2 (units 2.3 and 2.7). 

Again referring to Fig. 2, the Digital Item 2.1 
includes DIDs 2.2 and P>.esources 2.8. Each of the DIDs 
includes the IFMP Control Information Descriptor 2.4 and 
the IPMP Descriptors 2.7, The IFMP Control Inform.ation 
10 Descriptor 2,3 includes a IFMP Tool List 2.3,- a IPMP Tool 
Holder 2.5, and a Right Holder 2.6. The IPMP Tool List 2.4 
includes IPMP Tool IDs 2.41, Alternate IFMP Tool IDs 2.42, 

Tool Holder 2.5 includes IPMP Tool IDs 2.51 and IPMP Tool 
15 Body 2-51. Furthermore, the Right Holder 2.6 includes 

Pvi'^ht Tool IDs 2.61 and P>.i'^ht Ex'^^^ressions 2 . 62 . 

With referring to Fig. 3, organization of digital item 

container 3.1 will be described in detail. The container 

3.1 with the following arrangexuent is created by the server 
20 201 by placing elements. From the beginning of container 

3.1, Container 3.1 has Descriptor 3.11, Item 3.12, 3.13, 

and 3.14 in this order and is described in text format by 

using XML. 

Descriptor 3.11 shows, for example, what types of 
25 Items are included in the container 3.1 and also called as 
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Digital Item Declaration (DID) , or as Container Descriptor. 
Descriptor 3,11 includes IPMP scheme descriptor 3,2, shown 
as "Statement". At the beginning of IPMP scheme descriptor 
3.2f the IPMP control information descriptor is pla.ced/ 
5 which describes a list of tool(s) to be used when the 
server 201 encodes a content. 

Items 3.12 to 3.14 respectively relate to content such 
as motion pictures, still pictures, and audio. For example. 
Item 3.12 includes Descriptor 3.. 15 and one or m_ore 

10 Components such as Component 3.16. Descriptor 3.15 

describes unique information on Item 3.12. Component 3.16 
includes resource 3.17 and Descriptor 3.18 for resource 
3.17. The Descriptor (DID) 3.18 includes Digital Item 
Identification and Description (DIID) 3.5 which identifies 

15 Resource 3.17 by a identifier. The Resource 3.17 is an 
actual data such as motion pictures, still pictures, and 
audio. Alternately, P.esource 3.17 may be URL (Uniform 
Resource Locator) which specifies a server in a network, in 
which the actual data is stored, 

20 Each arrangement of Items 3.13 and 3.14 is the same as 

that of item 3.12. Items 3.13 and 3.14 have a Component 
which includes Descriptor (DIB) ana F>.esource. The 
respective Descriptors (DID) have Statements 3.3 and 3,4 as 
IPMP Scheme Descriptors. The IPMP Scheme Descriptor has an 

25 IPMP descriptor which specifies necessary IPMP information 
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on one of completely described IPMP Tool information and 
related control message for specific protected resource. 
IPMP descriptor is placed in the nearest resource 
Descriptor (i.e. a Descriptor (DID) corresponding to the 
5 resource) within the same Component parent element under 
the DID, to be distributed to Users. 

As shown in Fig. 2, different modules existing in the 
MPEG-21 system architecture can be briefly described as 
following: 

10 1) MPEG-21 (De)Mux (module 2.9) 

It is the standard interface to the outside world of 
the MPEG-21 Terminal. It receives (and sends) : DID of 
Digital Item(s) and Resources that form part of Digital 
Item.(s). The (De)Mux 2.9 is required to process binary- 

15 form MPEG-21 data which includes derauxing and converting of 
DID binary into XML fo text) . 

2) DID Parser (module 2.10) 

The DID Parser receives the DID from the MPEG-21 
(De)Mux 2.9 and parses the DIDL text declaring the 
20 structure of the Digital Item. 

3) IPMP Parser (module 2.11) 

The IPMP Parser 2.11 receives the IPMP information 
text (in XML) bold in the DID, and parses it. It will 
usually use IPMP Tool(s) to act upon this IPMP information 



wo 03/075575 



PCT/JP03/02462 



4) REL Parser (module 2.11) 

The R.EL Parser receives the P^EL text (in XML) hold in 
the DID or IPMP information;- and parse it. 

5) Content Representation Tool (module 2*13) 

5 The Content Representation Tool 2.13 takes the content 

for e.g./ decoding, composition, and rendering. It should 
be noted that the Content Representation Tools 2.13 are 
outside of the MPEG=21 Terminal for non=WG 11 standards. 

6) IPMP Tool Manager (mndule 2.19) 

10 The IPMP Tool Manager 2.19 processes IPMP Tool List(s) 

and retrieve the IPMP Tools that are specified therein (e.g. 
obtain missing IPMP Tools 2.15 before Resource (s) 2.8 stars 
to consume) . It is the key element to provide renewability 
if the IPMP Tool 2.17 is broken after a few years. 

15 7) Terminal-Tool Messages Interchange Interface 

(m.od 

It is implemented in the MPEG-21 Termtinal, to use for 
communication/interfacing with proprietary IPMP Tools wich 
can be pre-implemented^ or loaded from somewhere^ and the 
20 IPMP Tools 2.17 can be renewed in future. Using such 
interface is to provide interoperability between different 
MPEG-21 IPMP terminals with different IPMP Tools. 

8) IPMP Tools (module 2.17) 

It represents the proprietary Tool that performs IPMP 
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based on specified IPMP Interfaces. 

The above three modules and the units 2,4 and 2. Sin 
Fig. 2 have the same functionality as modules 1.6, 1.7, 1.8, 
and 1.9, and units 1.2 and 1 . 3 in Fig. 1. 

Next consumption of the DI protected by MPEG-21 IPMP 
will be described. 

1) User reqxiests specific content. 
After coiruriunication between the terminal 2 02 and the server 
201 is established via the network 200, the follovjing is 
made for the order in which different parts of the content 
are received and used: 

a) IPMP Requirements on the Terminal 2 02 should be 
placed with or before media requirements on the Terminal 
202; and 

b) Access Information and/or restrictions should 
precede Content Stream download information. 

( I PMP_Con t r o l_In f o_D e s cr ip t o r ) 

After DID 2.2 is received at the MPEG~21 {DE)MUX 2.9 
and sent to DID parser 2.10, the DID parser 2.10 extracts 
IPMP inform.ation and sends to the IPMP parser 2.11. Then 
the IPMP parser 2.11 extracts all IPMP information and 
transfers the inform.ation to the IPMP Tool Manager 2.19 and 
Message Router 2.16 in MPEG-21 IPMP system. Other IPMP 
Information such as IPMP message. Keys, etc could be put as 
OpaaueData in IPMP Desc^-ri r-l^r.T' n-r Pc^cr.^..,^ — ^ u. 
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DID^ When there is Rights Expression information under 
IPMP_Control_InfQ_Descriptor 2.2, it is transferred to the 
REL parser 2.12. The parsed rights information can be 
enforced by Rights Management Tool carried in the DID 2.2 
or the Resource through Descriptor Reference (remotely) . 

2) IPMP Tools descx^iption access 

The Tool Manager 2.19 accesses the IPMP Tool List 2.4. 
Using the IPMP Tool List, the Terminal prepares and obtains 
the IPMP Tools required for protecting and consuming the 
content . 

3) IPMP Tools retrieval 

If the IPMP tools 2.17 are available locally at the 
term.inal 2 02, proceed to next stepe Or, if IPMP tools are 
not available locally at the terminal 2 02, the term.inal 2 02 
attempts to obtain the Missing IPMP Tools 2.15. Some 
Missing IPMP Tools 2.15 may be carried in the Content 
itself. Other\-7ise,- the Missing IPMP Tools 2.15 must be 
obtained remotely. In our proposal [2], it was mentioned 
that "IPMP Tool Stream" could be carried inside the DID 
(Tool Holder) or carried in the Resource through Descriptor 
Reference. The IPMP Tool Manager accesses/acquires the 
missing IPMP Tools. The "IPMP Tool Stream" can be carried 
inside the DID (Tool Holder 2.5) or carried in the Resource 
2.8 through Descriptor Reference. The IPMP Tool Manager 
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4) Instantiation of IPMP Tools 

The Teriainal 202 instantiated the IPMP Tool(s) 2.17 
locally or remotely. The instantiated IPMP Tools are 
pro^^ided with initial IPMP Information from the DID. One 
or more IPMP Tools, identified in the DID, may use IPMP 
Information to determine security requirements for content 
access, and monitor and facilitate the establishirvent and 
maintenance of these security requirements in inter-Tool 
comjuunication . 

5) IPMP Initialization and Update 

This step is in parallel with Resource Consumption 
(DID parser 2,10 extracts references to Resources 2,8, 
MPEG-21 (DE)MUX 2.9 receives Resources 2,8 and sends to 
Resource Representation Tool). The Message Router 2.16 
routes IPMP Information to the IPMP Tools 2,17 and the 
terminal 2 02 consumes the content if allovjed by the 
requisite IPMP Tools 2.17. During Resource consum.ption, 
the complete procedure can be requested again. Requests 
for R.esource consumption are implicit within the process. 

Next, the enforcement of rights expression in MPEG-n 
IPMP system will be described. 

The Rights Expression inform.ation can be put in 
different places considering different applications. Here 
Rights information includes all the usage Rules, License 
irev, etc-- but not including tim.e variant key information. 
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It is therefore possible to: 

a) carry Rights inf orTnation out of band (i.e. out of 
any specific systems like MPEG-2/4/21) but by defining a 
way to link the Rights Information with the relevant 
content in a noririative manner for interoperability, as 
shown in Figure 4; 

b) carry Right inform_ation inside the specific system 
but before any media content as a global Rights description, 
as shown in Fig. 5; 

c) carry right Information in local to directly 
associated with its relevant content, in this way, rights 
information is actually scattered into each Resource, as 
shown in Fig, 6. 

In the following, each item (a), (b) , and (c) is 
further explained. 

a) carry Rights Information out of band (i.e. out of 
any specific systems like MPEG-2/4/21) 

In Fig. 4, Rights Information carried out of the band 
is illustrated, where REL/RDD (unit 4,3) can be delivered 
off-line and also can be delivered on-line with the content 
(unit 4.2). In the later case ^REL/RDD 4.3 should have a 
header (unit 4,4) to indicate .the segment of the REL/RDD 
part from the whole content that is transmitted to a 
compliant terminal 4.8 . Then the units 4.2, 4.3, and 4.4 
form, the content structure (unit 4.1). 
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RDD is used for associating each right with its 
relevant content by pointing to the content identifier that 
will have different names in different system. For example, 
in MPEG-2 PID (Program Identifier) is used and in MPEG-4 OD 
id and ESD id is used to identify its content within that 
system. 

REL/RDD information is created and attached together 
with the vcontent that may be protected. 

The REL/RDD (units 4.3 and 4.4) is inserted in the 
content as carousel to inform the term.inal 4.8 about rights 
information at any time when user accesses the protected 
content . 

The compliant term.inal contains a REL Stripper (module 
4.5) followed by REL/RDD Parser (module 4.6) that is linked 
to the MPEG-n IPMP System (module 4.7). 

In this case REL/RDD does not belong to any part of 
MPEG-n system, even MPEG-21 system.. It v/ill spoil the 
integrity and interoperability of MPEG-n system. 

b) carry right information insides the specific system 
but before any media content as a global Rights description 

In Figure 5 Rights information is carried in MPEG-n 
System in a global location,- like lOD in MPEG=4 system^ PSI 
in MPEG-2 system, and DID in MPEG-21 system. In this case 
REL/RDD belongs to one component of the MPEG-n system 
(m.odule 5.1). 
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REL/RDD information (unit 5.3, as long as they are not 
the time variant key inf oriuation) can be placed in a global 
location to describe all the relevant Rights information 
regarding all the consumed media contents before starting 
to consume any of the media contents (unit 5.2) . It is 
done by associating each Right vjith the corresponding 
content identifier that is defined in RDD. 

In the terminal 5,8- such a transmitted content is 
retrieved by MPEG-n Demux (module 5.4), then passed to IPMP 
& REL/RDD Parser (module 5.5) followed by MPEG-n Resources 

/ .1-- n _ n \ 

\lLLUU.UXe O.D) , 

c) carry rights information in local to directly 
associated with relevant content, in this vvav/ rights 
information is actually scattered into each Resource 

In Figure 6 Rights information is carried in MPEG-n 
system (m.odule 6.1) in local and scattered into each 
relevant content (module 6.2), In that case. Rights 
information has to be verified each time when user accesses 
the content where the Rights maybe digitally signed, which 
will cause repetitive workload to the terminal 6.8 compared 
to the method b) shown in Figure 5. The terminal 6.8 
includes a MPEG-n DeMux (unit 6.4), a IPMP Parser (unit 
6.5), and MPEG-n Resources and a REL/RDD Parser (unit 6*6). 

It is clear that it is convenient to obtain all the 
Licenses and Usage Rules in the beginning just before 
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consuming the content, like the way in a) and b) . 

After comparing three different ways to carry Rights 

in different places in the above, it is suggested to take 
method b) since it is good in the sense of integrity and 

consistence with MPEG-n IPMP system. In this case Rights 
Holder Position in MPEG-2/4/21 IPMP System is further 
discussed below. 

Then, the Right Holder in MPEG-21 IPMP and its mapping 
to MPEG-2/4 IPMP will be described. Specifically, one 
detailed specification of the above-mentioned method "b" 
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It is proposed to use Rights Holder (unit 2.6) in IPMP 
Control Information Descriptor (unit 2.3) to hold the 
Rights Expression information. IPMP Control Inforcaation 
Descriptor is designed with the outmost Container 
Descriptor's Statement. So the Rights information here is 
the outmost information before accessing the whole DID 
represented Items, Components, and Resources. This concept 
is illustrated in Figure 2 as for the detail architecture 
of MPSG-21 IPMP system. 

This diagram is an updated version by incorporating 
other elements of MPEG-21 into MPEG-21 IPMP. In the left 
side, an MPEG-21 Digital Item 2.1 protected by MPEG-21 IPMP 
is shown where Rights holder 2 . 6 is holding REL information 
and is placed under IPMP Control lvrr,-rm^^^ r^r^ r.^ = r^vi ^4-^^ o q 
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In an MPEG-21 IPMP terrranal 202, REL parser (module 2,12) 
is required to interpret and transfer Plights periuission to 
the terminal 2 02 before starting to consume any content. 

The Fig. 12 shows the flow chart of MPEG--21 DI 
consumption with Rights information carried in IPMP Control 
Information. In Fig. 12, same numeral as that in Fig. 2 is 
allocated to each elem.ent. 

There are several advantages to hold the Rights 
Expression information in such a way: 

a) The entire Rights Expression part can be easily 
protected by IPMP system, and in the terminal the Rights 
information is just needed to be verified once before any 
content to be consumed- 

b) When the DI is entirely protected by the IPMP 
system so that a customer would have the opportunity to 
review the license agreement before actually executing any 
of the protected resources. 

c) It will be convenient for content creator. This is 
exactly true when the Resource (s) is ready-made and content 
creator won't change the Resource any more. 

d) It is easy to map to the existing MPEG-2/4 IPMP if 
this structure is adopted in MPEG-21 IPMP. 

Then, mapping Rights Holder position from MPEG-21 to 
MPEG- 4 IPMP will be described. 

As shown in a Diagram of Fig. 8, the reasonable place 
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to carry such XML based Rights messages unit 8.1 (in binary 
toriuat) is in one of the Elementary Streams like Scene 
Description Stream (unit 8.2) or Object Description Stream, 
(unit 8.3). Inside the lOD (unit 8.4), an ES Descriptor 
(unit 8.5) will describe the stream. This ESD with IPMP 
Tool List Descriptor (unit 8.6) formes MPEG-4 IPMP Control 
Information Descriptor. 

In such case, BIF Stream describes the relationship 
betv/een different objects in term of spatial relationship 
and time relationship, while IPMP Scene/IPMP Rights stream. 
aescri.be d-ifferent irights permissions applied to each 
object by using OD ID and ESD ID to associate with the 
corresponding contents . 

If it is preferable that a tidy and clear Rights 
Structure for all the Objects set up in the beginning of 
decoding, this way is the best choice. At the same time, 
an Overall IPMP Scene Structure can also be provided to be 
used in the Content Creation to illustrate the relationship 
for different kinds of Rights applied to different objects. 

This way also makes good sense since lOD is the 
entrance point in MPEG-4 IPMP just like DID is the entrance 
point in MPEG-21 IPMP. It is indeed an appropriate m.apping 
from MPEG-21 IPMP to MPEG-4 IPMP. 

If Rights information is transmitted with the content 
where the content and Rights information are tiqhtly 
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bounded together, V7e have to define a normative way for 
carrying the rights in pre-vdefined location for 
interoperability. We also consider a nevj stream for MPEG-4 
IPMP system to carry Rights information in a pre-defined 
5 location. The same suggestion is further elaborated in 
this invention. 

Next,. Mapping Rights Holder position from MPEG-21 IPMP 
to MPEG-2 IPMP will be described. 

In MPEG-2 system, as indicated in current working 
10 draft of MPEG-2 IPMP, IPMP Control Information (refer to 
unit 10.1 in Fig. 10) defined as another table besides PAT, 
PMT tables, is inserted to PSI (Program Specific 
Inform^ation) to describe IPMP related information as v^ell 
as Rights Description or Rights information (unit 10.3) , 
15 Before content is started, all IPMP and Rights 

information will be retrieved and processed according to 
their associated PID (Program Identifier) numbers. 

As shown in Figure 10, a Content Structure protected 
by MPEG-2 IPMP system is illustrated where Rights 
20 information is carried in IPMP Rights Container. 

It is another good mapping from MPEG-2 1 IPMP to MPEG-2 
IPMP since PSI is the entrance point in MPEG-2 IPMP just 
like DID is the entrance point in MPEG-21 IPMP. 

IPMP and Rights information placed in PSI in MPEG-2 
25 IPMP is similar to IPMP and Rights information placed in 
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DID in MPSG-21 IPMP. 

Second EitibodixTLent 
A second embodiment relates to another detailed 
specification of method "b" described in the first 
5 embodiment. 

In the first embodiment. Rights Holder is placed under 
IPMP Control Information Descriptor in MPEG-21 IPMP System, 
as shown in Fig. 2 since it is considered as one type of 
IPMP information. On the other hand, the REL is also 
10 possible to be placed in the same level of the IPMP Control 
inf ormtation. This concept is illustrated in Figure 7 as 
for the detail architecture of MPEG-21 IPMP system. 

This diagram is an another updated version by 
incorporating other elements of MPEG-21 into MPEG-21 IPMP. 
15 In the left side a MPEG-21 Digital Item (module 2.1) 
protected by MPEG-21 IPMP is shown where Rights Descriptor 
or Rights holder (module 7,1) is holding PJEL inform^ation 
and is placed in DID Container 2.2 in the same level of 
IPMP Control information. In a MPEG-21 IPMP terminal 2 02, 
20 REL parser 2.12 and IPMP Parser 2.11 are required to 
interpret and transfer Rights permission and IPMP Control 
inform.ation to term-inal 202 before starting to consum.e any 
content. In Fig, 7, same numerals are allocated to same 
elements as those in Fig. 2. 
25 If Rights Expression part is protected by IPMP system. 
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it is not convenient to retrieve IPMP information before 
IPMP Parser 2.11 is executed first. So in this case, IPMP 
Parser 2.11 has to be done by following REL Parser 2.12, 

The Fig. 13 shows the flow chart of MPSG-21 DI 
5 consuKiption with Plights information carried outside and 
before IPMP Control Information. In Fig. 13, same numeral 
as that in Figs. 2 and 7 is allocated to each element. 

Then, mapping Riglats Holder Position from MPEG-21 IPMP 
of MPEG"4 IPMP x-zill be described. 
10 The reasonable place to carry such XML based Plights 

messages (in binary format) is in one of the Elementary 
Streams like Scene Description Stream or Object Description 
Stream, as shown in the Diagraiu, Figure 9. Inside the lOD, 
an ES Descriptor (unit 9.1) will describe the stream and 
15 outside the IPMP Control Information in unit 9.2 but it 
parallels to IPMP Tool List Descriptor inside IPMP (refer 
to units 9,2 and 9.4) . 

Carrying the Rights Information in ES_Descriptor 
inside or outside the IPMP Control Information should have 
20 the same intent as described in the first embodiment of 
this invention. 

Then, mapping Rights Holder Position from MPEG-21 IPMP 
to MPEG-2 IPMP will be described. 

In MPEG-2 system, as indicated in current working 
25 draft of MPEG-2 IPMP, IPMP Control Information defined as 



wo 03/075575 



PCT/JP03/02462 



another table besides PAT, PMT tables, is inserted to PSI 
{Program Specific Information) to describe IPMP related 
information as well as B,ights information* 

Before content is started to consume, all IPMP and 
5 Plights information Vv^ill be retrieved and processed 
according to their associated PID (Program Identifier) 
numbers . 

As shown in Figure 11, a Content Structure protected 
by MPSG~2 IPMP system is illustrated where Rights 
10 information or Rights Description {unit 11,4) is carried in 
Pvights Container (unit 11.1) parallel to IPMP Control 
Information (refer to units 11.2 and 11.3). 

It is another good mapping from. MPEG-21 IPMP to MPEG-2 
IPMP since PSI is the entrance point in MPEG-2 IPMP just 
15 like DID is the entrance point in MPEG-21 IPMP. 

IPMP and Rights inform^ation placed in PSI in MPEG-2 
IPMP is similar to IPMP and Rights information placed in 
DID in MPEG-21 IPMP. 

Third Embodiment 

2 0 Fig. 14 shows a third embodiment of the invention. 

DID container 2.2 also includes a DIA Descriptor 14.10 
including a DIA (Digital Item. Adaptation) Tool List 14.1. 
Further, the Terminal 2 02 is also provided with a DIA 
Parser 14.4. 

25 With regard to the DIA Descriptor 14,10, a process in 
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the teriainal 202 for consuming the digital item comprises 
the following steps of: 

transferring the digital item to the I^IA parser 14.4 
if the digital item can not be directly consumed; 
5 interpreting description of the DIA Descriptor 14,10 

for the digital item; 

interacting between the user and the terminal 2 02 to 
feed back information including user's terminal condition, 
network condition,- and user's preference; 
10 providing instructions for the user according to the 

feed backed information; 

collecting DIA tools 14,6 by a DIA Tool Manager 14.3 
for consuming the digital item; and 

transferring the digital item, to the DIA tools 14.6 
15 for consumption. 

XTz-vz-Hn cr« n ^ i-T-i.^^ PiTtX ^Vr-sr^ l J.n a "h 1/1 1 t- r> -r- r^' q <= « 

X. WV^l--i.>wJ_l,iJ.V~-j W J-i, l^XX^ J_/ i. JL^^l^t^ l_J.J.V^ J- W \^>^ W »-J 

com.prising following steps of: 

processing Information of DIA Tool List 14,1 by DIA 
Tool Manager 14.3; 
20 retrieving missing DIA Tools 14.2 by defined or 

private manner; 

collecting the DIA Tools 14,6 requested in the DIA 
Tool List 14.1; 

installing the DIA Tools according to their functions 

Ok 4 -I- V, ^ 4~ ^ n 4 ^ 1 o n o • 
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configuring and initiating the DIA Tools in the 
terininal 202 according to the DIA Tool Manager 14.3 and 
Description Messages (DIA Descriptor 14.10) received and 
processed by the DIA Parser 14,4; and 
5 Activating the DIA Tools integrated in the terminal 

when there is needed. 

In case that v/aterinarking technique is used, the 
process further comprises the following steps of: 

decrypting the protected digital item by the IPMP tool 
10 2,17 indicated in the IPMP tool list 2.4 if the digital 
item is encrypted; 

verifying IPMP related information, messages, and 
rights information if protected by digital signature; 

authenticating tools, users, and terminals if they are 
15 indicated to be performed so; 

extracting watermarks for copy control 

inform^ation/usage rules from^ the digital item for further 
processing if there is such indication in IPMP message 
parsed by the IPMP parser 2.11, DID description parsed by 
2 0 the DID parser 2.10, or DIA description parsed by the DIA 
parser 14.4; 

extracting vvatermarks for authentication information 
from the said digital item, for further processing if there 
is such indication in IPMP message parsed by the IPMP 
25 parser 2.11, DID description parsed by the DID parser 2.10, 



wo 03/075575 



PCT/JP03/02462 



34 

or DIA description parsed by the DIA parser 14 .4; 

extracting waterraarks for persistent content ID 
information froia the digital item for further processing if 
there is such indication in IPMP message parsed by the IPMP 
parser 2,11- DID description parsed by the DID parser 2.10^ 
or DIA description parsed by the DIA parser 14.4; 

consuming the said un-protected digital item by the 
representation tools ; 

embedding watermark inform_ation for updating copy 
control information/usage rules after consumption of the 
digital item. 

Fourth Embodiment 

A DID mLsnu for user's selection of specific digital 
item can be introduced to the MPEG-21 system, of the 
invention. With making reference to Fig. 15, process in 
the terminal 2 02 for processing the DID menu comprises the 
following steps of: 

receiving the DID menu from the server 2 01 together 
with other information in a carousel style via the network 
200; 

parsing the DID 2.2 by the DID Parser 2.10 in the 

terminal 2 02 to interpret the actual meaning of each 
element and statement by the terminal 202; 

making the DID menu 15.1 to be readable by the user; 
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digital item 2.1 if there is REL information is found with 
the digital item; 

recei%^ing the requested digital item from the server 

201; 

5 un-protecting the digital item, for further consumption 

if the digital item is protected by the IPMP; 

identifying the resources 2.8 linked to the digital 

item; 

collecting the requested tools including the IPMP 
10 tools (m-odule 2.17) and DIA tools (module 14.6 in Fig. 14) 
for consumption of the digital item; 

activating the tools based on the Message Interchange 
Interface (modules 2.16 and units 14.5 in Fig. 14) . 

Fifth Embodiment 

15 The DID menu can be stored in the sever 201 and 

browsed by a browser in the terminal. With making 
reference to Fig. 16, process in the term.inal 202 for 
browsing and processing the DID menu comprises the 
following steps of: 

20 browsing the DID menu 16.1 stored in the server 201 

from a DID browser 16.2 in the terminal 202 remotely via 
the netv/ork 2 00; 

parsing and interpreting each DID element by the DID 
browser 16.2; 

25 selecting a dig'ital item described by the DID (unit 
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2.2 in Fig. 14) by the user; 

verifying rights and usage rules ivhich is bound to the 
digital item if there is REL inf orniation is found with the 
digital item; 

5 retrieving the requested digital item fx^om the server 

201; 

un--protecting the digital item for further consumption 
if the digital item is protected by IPMP; 

identifying the resources 2.8 linked to the digital 

10 item; 

collecting the requested tools including the IPMP 
tools (module 2.17 in Fig. 14) and DIA tools (module 14.6 
in Fig. 14) for consumption of the digital item; 

activating the tools based on the Message Interchange 
15 Interface (modules 2.16 and units 14.5 in Fig. 14). 

J. X J. J_ _l_XXV^^XXl_-l-WJ.X W -t- V \^ l^XXN-^ ^ J_ W -l_ V^XLL \^ J— -l-^^XX-l-iX^-i I^AXX 

interoperable and secure architecture to be used in MPEG-21 
DI delivery or transmission in a secure manner, by providing 
a standard way for MPEG-21 IPl^P system iir^lementers to build 
20 the whole IPMP system for MPEG-21 related "content" 
distribution and protection; 

This invention solves the problem of designing an 
interoperable and secure architecture to be used in MPEG-21 
DI delivery or transmission, in a secure manner, by providing 

V :a c?T-o-i-i/-5o -v-^ rT-^T, -i=^-^ Tv/r"DTP r- _ O 1 TPTvT'P c; \ r «= t= qtyi n -mi-x 1 ^ v. 4- ^ -t- r^ "Kn t 1 
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the vvhole IPMP system for MPEG-21 z-elated "content" 
distribution and protection; 

This inx?-ention also solves the problem of dynamically 
yet tightly associating rights information with MPEG-21 
content, by designing appropriate places to put the Rights 
Holder including the important Rights Expression information 
under MPEG-21 architecture. The Rights Holder can either be 
put out of band, or put under IPMP system, or parallel to 
IPMP system, or scattered into resources* 

This invention further solves similar rights 
association problem for MPSG-2/4 IPMP system by mapping the 
Rights Holder to MPEG-2/4 system. 

The invention being thus described, it will be obvious 
that the same may be varied in many ways • Such variations 
are not to be regarded as a departure from the spirit and 
scope of the invention, and all such modifications as would 
be obvious to one skilled in the art are intended to be 
included within the scope of the following claims. 
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CLAIMS 

1. A method of digital item processing for use in an 
apparatus for a MPEG-21 system, comprising: 

requesting a digital item to be delivered to the 
5 apparatus via a network, 

receiving the requested digital item, 

de^multiplexing the received digital item by a de- 
multiplexer, 

retrieving a digital item, container including a 
10 Digital Item Declaration (DID) including one or more 
elements from the de-multiplexed digital item, 

parsing the DID by a DID parser to interpret the 
actual meanings of each eleraent of the DID, and 

transferring the element to an Intellectual Property 
15 Management and Protection (IPMP) parser for activating an 

T kjtv/TTj 4-^.^1 T-P -t-Vi/^i A -t- ^ v—K^ 1^ ^ T- Ck 1 QmoTnT^ H «=! T^cil :ai~ori 

protection and management of the digital item. 

2. A method according to claim 1, further comprising: 

20 transferring the element to a Rights Expression 

Language /Rights Dictionary Declaration (REL/RDD) parser if 
the interpreted element is related to rights information 
including rights and usage rules for the digital item* 
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transferring the element to a content representation 
tool if the interpreted element is related to content 
representation and consumption, and 

activating the content representation tool* 

5 

4. A m.ethod according to claim 3, further comprising: 
transferring the element to a future defined tools if 

the interpreted element is related to functions other than 
IPMP and REL/P.DD. 

10 

5. A method according to claim 1, further comprising: 
processing an IPMP tool list included in the DID by a 

IPMP tool manag"er,- 

retrieving a m.issing IPMP tool,- 
15 collecting all the IPMP tools requested in the IPMP 

J T T4«4- 

installing the IPMP tool according to its function, 
configuring and initiating the IPMP tool according to 

an IPMP messages received and processed by the IPMP parser, 
20 and 

activating the IPMP tool. 

6. A method according to claim 1, wherein a tool 
identifier (ID) is assigned to each IPMP tool, 

25 wherein an IPMP tool list is created to indicate which 
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IPMF tool is used for protecting the digital item, and 

wherein the IPMP tool list is carried in an IPMF 
control inforiaation descriptor included in the DID 

container^. 

5 the method further comprising: 

retrieving IPMP control information from the IPMP 
control information descriptor when the DID is parsed by 
the DID parser;^ 

transferring the IPMP control information to the IPMP 
10 parser, 

transferring the IPMP tool list to an IPMP tool 
manager, 

processing the IPMP tool list by the IPMP tool manager, 

and 

15 retrieving the IPMP tool if there is a missing IPMP 

toO_L • 

7- A method according to claim 1, wherein an IPMP control 
information descriptor is included in the DID container, 

2 0 further comprising: 

retrieving the IPMP control information descriptor 
including an IPMP tool list, an IPMP tool holder, and a 
right holder from the DID container when the DID is parsed 
by the DID parser, 

25 transferring the IPMP control information descriptor 
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to the IPMP parser, 

retrievirxg thxe IPMP tool list from the IPMP cor-trol 
information descriptor by the IPMP parser, 

retrieving the IPMP tool if it is carried in the IPMP 
5 toll holder, and 

retrieving rights information if such information is 
carried in the right holder. 



8. A method according to claim. 2, wherein the DID 
10 container includes an IPMP control inform^ation descriptor 

including a right holder with a right tool ID and a right 

expression, and 

wherein rights information including rights and usage 

rules is carried in the right holder, and 
15 wherein different rights and usage rules are 

associated with the corresponding digital items using their 

persistent IDs in the rights information, 
the method further comprising: 

parsing the IPMP control information descriptor to 
2 0 retrieve the right holder by the IPMP parser, 

transferring the right holder to the REL/RDD parser, 

parsing the right holder by the PxEL/PX'D parser to 
interpret the rights and usage rules, and 

verifying the rights and usage rules associated with 
25 the d-xgiuo-l item.. 
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9. A method according to claim 2, wherein the DID 
container includes an IPMP control information descriptor 
and a right holder with a right tool ID and a right 

5 expression^ the DID container and the right holder being 
parallel within the DID container, 

wherein all rights information including rights and 
usage rules is carried in the right holder, and 

wherein the different rights and usage rules are 
10 associated with the corresponding digital items using their 
persistent IDs in the rights information, 
the method further comprising: 

retrieving the right holder in the DID parsed by the 
DID parser, 

15 transferring the right holder to the REL/RDD parser, 

parsing the right holder by the REL/RDD parser to 

interpret the rights and usage rules, 

verifying the rights and usage rules associated with 

the digital item* 

20 

10, A method according to claim 2, wherein right 

information including rights and usage rules is carried out 
of band, 

wherein a header for REL/RDD information is defined to 
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wherein the different rights and usage rules are 
associated with the corresponding digital iteias using their 
persistent IDs in the rights information/ 

receiving the header with other information, 
5 stripping the header to retrieve the PvEL/R.DD 

information, 

transferring the REL/R.DD inform.ation to the REL/RDD 
parser to interpret the rights and usage rules, and 

verifying the rights and usage rules associated with 
10 the digital item. 

11. A method according to claim. 8, v/herein the rights 
information including the rights and usage rules is 
contained in the IPMP control information descriptor, 
15 wherein the IPMP control information is carried in 

initial object descriptor (lOD) for MPEG--4 system, and 

wherein the apparatus is compliant with MPEG-4 
standard, 

the method further comprising: 
20 receiving the lOD Vv^ith other information, 

retrieving the lOD to obtain the IPMP control 
inform.ation descriptor, an.d 

parsing and interpreting the right information by the 
REL/RDD parser. 



25 
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12. A method according to claim 9, wherein the IPMP 
control information descriptor and right information 
including rights and usage rules are respectively carried 
in different lODs for MPEG-4 system in parallel, 

5 wherein the apparatus is compliant with MPEG'-4 

standard, 

the method further comprising: 
receiving the lOD with other information, 
retrieving the lOD to obtain the IPMP control 
10 inform^ation descriptor, and 

parsing and interpreting the right information by the 
REL/RDD parser. 

13. A method according to claim 8, wherein the rights 
15 information Including the rights and usage rules is 

contained in the IPMP control information descriptor, 

wherein the IPMP control information descriptor and 

rights information are carried in program specific 

information (PSI) for MPEG-2 system, and 
2 0 wherein the apparatus is compliant with MPEG-2 

standard, 

the ruethod further comprising: 
receiving the PSI with other information, 
retrieving the PSI to obtain the IPMP Control 
25 Inform.ation descriptor. 
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retrieving the rights information, and 

parsing and interpreting the rights inforination by the 
R.EL/RDD parser. 



5 14, A method according to claim 9, 'vvherein the rights 
information including rights and usage rules is carried in 
a rights container included in PS I for MPEG-2 system., the 
right container being in parallel to the IPMP control 
inform.ation descriptor in the PSI, and 
10 wherein the apparatus is compliant with MPEG-2 

standar-d, 

the method further comprising, 
receiving the PSI vjith other information, 
retrieving the PSI to obtain the rights information by 
15 the REL/RDD parser, and 

parsing and interpreting the right information by the 
PxEL/RDD parser. 



15, A method according to claim 2, wherein the rights 
2 0 information is carried in a right holder, 

wherein the right holder is associated with the 
CO r r e sponomg dgiTi.a-L jLtexiis, ano. 

wherein the right holder is in the front of the whole 
digital item container. 



25 
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16. A method according to claim 2, wherein the rights 
information is carried in a rights holder^ and 

wherein the right holder is scattered locally v/ith 
each of the relevant digital items, and delivered to the 
5 apparatus directly associated with its relevant digital 
item. 

17. A method according to claim. Ir further comprising: 
transferring the digital item to a digital item 

10 adaptation (DIA) parser if the digital item is to be 
consumed indirectly, 

interpreting description of the DIA for the digital 

item, 

interacting between the user and the apparatus to feed 
15 back information including user's terminal condition, 
netv/ork condition, and user's preference, 

providing instructions for the user according to the 
feed backed information, 

collecting a DIA tool for consuming the digital item, 

20 and 

transferring the digital item to the DIA tool for 
consumption . 

18. A method according to claim 1, wherein the digital 
25 item container further includes a DIA tool list. 
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the method further comprising: 

processing the DIA tool list by the DIA tool managers- 
collecting the DIA tools requested in the DIA. tool 

list, 

5 installing the collected DIA tools according to their 

functions, 

configuring and initiating the DIA tools according to 
predetermined message interface and description message 
received and processed by a DIA parser, and 
10 activating the DIA tool. 



19. A method according to claim 17, vjherein the digital 
item is un=protected for further consumption if the digital 
item, is protected by IPMP, 
15 the method further comprising: 

decrypting the protected digital item by the IPMP tool 
indicated in the IPMP tool list if the digital item is 
encrypted, 

verifying IPMP related information, messages, and 
20 rights information if protected by digital signature, 

authenticating tools, users, and terminals if they are 
indicated to be performed so, 

extracting watermarks for copy control 

information/usage rules from the digital item for further 
25 processing if there is such indication in IPMP message 
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DID parser, or DIA description parsed by the DIA parser, 

extracting watermarks for authentication information 
from the digital item for further processing if there is 
5 such indication in IPMP message parsed by the IFMP parser, 
DID description parsed by the DID parser, or DIA 
description parsed by the DIA parser, 

extracting watermarks for persistent content ID 
inform.ation from, the digital item for further processing if 
10 there is such indication in IPMP message parsed by the IPMP 
parser, DID description parsed by the DID parser, or DIA 
description parsed by the DIA parser, 

consuming the un=protected digital item by the 
representation tools, 
15 embedding watermark information for updating copy 

control inform.ation/usage rules after consumption of the 
digital item., 

20. A method of digital item processing in an apparatus 
20 for a MPEG-21 system, comprising: 

receiving a DID menu together with other information 
including DID in a carousel style via a netvjork, 

parsing DID by a DID parser to interpret the actual 
meaning of each elem^ent of the DID, 
25 making the DID menu to be readable by a user. 
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selecting a digital item, from the DID menu by the user, 
verifying rights and usage rules v/hich is bound to the 

digital item if REL information is found with the digital 

item, 

5 retrieving the requested digital item, 

un-protecting the digital item, for further consum.ption 
if the digital item, is protected by IPMP, 

identifying a resource linked to the digital item, 

collecting the requested tools including IPMP tools, 
10 content representation tools, and DIA tools for consumption 
of the digital itemi, 

activating the tools according to predetermined 
itiessage interface if such tools are required in the 
consumption of the digital item. 

15 

21. A method of digital item, processing in a MPEG-21 
system, wherein the system includes a server and a client, 
comprising: 

browsing a DID menu stored in the server remotely from 
20 the client by a DID brov/ser via a network, 

parsing and interpreting each DID element by the DID 
broivser, 

selecting a digital item described by the DID by a 

user, 

25 verifying rights and usage rules bound to the digital 
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item if REL information is found with the digital item, 

retrieving the requested digital item from the server 
to the client^. 

un-protecting the digital item for further consiomption 
5 if the digital item is protected by IFMP, 

identifying a resource linked to the digital item., 
collecting the requested tools including IPMP tools, 
content representation tools, and DIA tools for consuiaption 
of the digital item, 
10 activating the- tools according to predetermined 

message interface if such tools are required in the 
consumption of the digital item. 
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